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In robot games on Z, two players add integers to a counter. Each player has a finite set from which he 
picks the integer to add, and the objective of the first player is to let the counter reach 0. We present 
an exponential-time algorithm for deciding the winner of a robot game given the initial counter value, 
and prove a matching lower bound. 



1 Introduction 

Robot games (4| are played by two players, a reacher and an opponent, by updating a vector of m integer 
counters. Each player controls a finite set of integer vectors in TP 1 . Plays start with a given initial vector 
vo E Z m of counter values, and proceed in rounds. In each round, first the opponent and then the reacher 
adds a vector from his set to the counter values. The reacher wins when, after his turn, the vector of 
counter values is zero. 

We consider the problem of determining the winner of a robot game for dimension m = 1. Towards 
this, we present an algorithm for solving this problem in EXPTIME and show that the bound is hard. 

Robot games are a particular kind of reachability games. Such games are played on a graph (Q,E), 
called an arena, where the set of vertices Q is partitioned into <2i and Q2 to designate which player is in 
turn to move. Here, a play is a (possibly infinite) sequence of vertices qoqi ■ • ■ starting with a given initial 
vertex q$. At any stage i, if qi E <2i the reacher chooses a successor qt + \ of qi such that (qi,qt+\) E E; 
otherwise the opponent chooses the successor. The objective is given by a subset Q' of Q: the reacher 
wins a play if it visits a vertex in Q'. 

The winning set in reachability games, i.e., the configurations from which the reacher has a winning 
strategy, can be computed by the attractor construction [10 ]. However, in robot games, we have infinitely 
many configurations, so we will need further tools. It turns out that here, the winning set is closed under 
linear combinations. For dimension one, this implies that there exists a bound such that the winning set 
becomes easy to describe from this bound onwards. The key idea of our algorithm is to perform the 
attractor construction up to such a bound, which we compute using a theorem from ifTTI . 

In view of the simplicity of their description, it may come as a surprise that robot games are EXPTIME- 
hard. We prove this by reduction from countdown games |0, another class of reachability games, with a 
nonnegative counter that can only decrease. 

Robot games belong to the family of reachability games on counter systems. Such games are played 
on a labelled graph (Q,E) where the set of edges is E C Q x 7L m x Q and there is a vector of m counters. 
When an edge (q, v, q') is taken, the vector of counters is updated by adding v to it. In counter reachability 
games, the objective of the reacher is either a set of vectors or a set of pairs (vertex,vector). We can view 
robot games as counter reachability games on an arena with only two vertices. 
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Robot Games on the Integer Line 



We hope that settling the complexity of one-dimensional robot games will help improving the EX- 
PSPACE upper bound that follows from |[2], for deciding the winner of counter reachability games on 
the integer line. 

2 Definitions 

When we write "positive" or "negative", we always mean "strictly positive" or "strictly negative". We 
write — N for the set of nonpositive integers. 

A robot game [4] in dimension one is a pair (U, V), where U and V are finite subsets of Z. The robot 
game is played by a reacher, who owns the subset U, and an opponent, who owns the subset V. Given 
an initial counter value xq € Z, a play proceeds in rounds. In a round that starts at the counter value 
x € Z, the opponent chooses what we call a move v € V and updates the counter to x + v, then the reacher 
chooses a move u G U and updates the counter to x + v + u, in which the round ends. The play ends and 
the reacher wins it if the round ends at 0, else a new round is played. By convention, the reacher wins 
immediately when a play starts at 0. 

To represent robot games, we draw their two vertices, O for the reacher and □ for the opponent, and 
two edges that list the set of each player. 



-1,3 




-1,0,4 

Figure 1: Example of a robot game for the sets U = {—1,0,4} and V = {—1,3}. 

Formally, a play is a finite or infinite sequence Z(V£/)* or Z(V[/) ffl . A play prefix in a robot game 
is a word % € Z(VU)* U Z(VU)*V, the first letter of this word is the initial counter value and the other 
ones are the moves players do in the play prefix. We associate to a play prefix covo^o . . . V/, its destination 

cq + v + u -\ Vv h . 

A strategy for the reacher (resp. for the opponent) is a function a : Z(VU)*V — > U (resp. a : 
Z(VU)* — > V). A strategy a is memoryless if all play prefixes with the same destination have the same 
image under a. We then take the destination of a play prefix 71 instead of % itself as argument of a 
memoryless strategy, which we define from now on as a function Z — > U or Z — > V depending on the 
player. 

A counter value x is winning if there exists a reacher strategy, such that for all strategies of the 
opponent, the reacher wins the play that starts at x and in which each player moves according to his 
strategy. We switch reacher and opponent in the last sentence to define the notion of a losing counter 
value. The decision problem associated to a robot game {U,V) and an initial counter value x G Z asks 
whether x is winning. 

By the Gale-Stewart theorem 0, robot games are determined: In any robot game, every initial 
counter value is either winning or losing. Robot games are even positionally determined, because they 
are reachability games, which means that if a player has a winning strategy, then he also has a memoryless 
winning strategy. 

A linear set in Z is a set of the form {x + Y!i=\ ki x i I ki,...,k„ G N}, for some integers x,x\, . . . ,x n . 
In other words, it is the least set that contains x and is closed under addition of integers in {xi, . . . ,x n }. 
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We denote that set by x + ({x\ ,x n })fq or simply x + xiN when n = I. We also write (Y)® rather than 
+ (J / )n- We say that an integer is Y -reachable if, and only if, it belongs to (F)n- 

The amplitude of a robot game (U,V) is the integer interval bounded by the extremal combinations 
of moves in a round. We denote it by Ampl(£/,V) = [min(V) + mm(U),max(V) +max(E/)J. We also 
define for any k € N the integer interval Ampl k (U,V) = [min(V) + min(£/) — fc,max(V) +max(t/) + &]. 

We now give some basic properties of robot games. Let us first remark that robot games are invariant 
under translation: Whenever a player can make a move from x to x', the same move leads from y to 
y — x+x 1 . 

Proposition 1: If two counter values are winning in a robot game, then their sum is also winning. 

Proof. Let i£Z and y € Z be two winning counter values. Let a x and a y be winning strategies of the 
reacher from x and y. Because the game is invariant by translation, the reacher can enforce a play that 
starts at x + y to visit y after one of his turns with the strategy z i-> <J x (z — y). After this first visit to y, the 
reacher wins by using a y . He always knows whether y was visited during a play prefix (x + y)voUQ . . . v/,, 
a necessary and sufficient condition is that a partial sum (x + y) + vo + uq H h v, is y. □ 

As a consequence, if all counter values in a set X C Z are winning in a robot game, then every 
X -reachable counter value is winning. This guarantees that the winning set is linear. 

The next proposition states what happens when a player can force the counter value to increase or 
decrease unboundedly. 

Proposition 2: Let (U,V) be a robot game. 

• If 'max(y) > — min(£/), then each positive counter value is losing. Similarly, if 'min(V) < — max(£/), 
then each negative counter value is losing. 

• Ifma\(U) > — min(y), and if there exists a bound above which each counter value is winning, 
then each counter value is winning. The same holds ifmin(U) < — max(V), and if there exists a 
bound below which each counter value is winning. 

Proof. • We consider a robot game (U,V) in which we have max(V) > — min(£/). For any positive 
counter value x and all moves vi, . . . ,Vk € V, ui,...,Uk G U, the opponent wins by playing the 
strategy xv\u\ . . . vuuu >->■ max(V ): every round ends in a counter value that is greater than or equal 
to the previous one, no matter what the reacher does. The case where min(V) < — max(£/) is 
analogous for negative counter values. 

• (First case only, the second one is analogous) We consider a robot game (U, V) for which we have 
max(£/) > — min(V), and for any counter value y above a certain x G Z, the reacher has a winning 
strategy o y . Here is the winning strategy for the reacher from any initial counter value: In a play 
prefix where no counter value above x has been visited, he plays max(£/ ); in a play prefix ending at 
z where the first counter value above x visited is y, he plays G y (z). Because max(J7) > — minfV), 
after every round the counter value visited grows until it goes over x where the reacher will win 
afterwards. Like in the proof of Proposition 1, the reacher knows whether the first case or the 
second one is the right one and what the value of y is. 

□ 
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3 The complexity of one-player robot games on the integer line 

When there is only one player in a robot game, i.e., V = {0}, the order of the moves does not matter. The 
reacher has a winning strategy if, and only if, for each move u £U ', there exists a number of times the 
reacher must use u, that is to say, the negative of the initial counter value is a positive linear combination 
of moves in the set U. We thus make a link between one-player robot games and linear programming. 

Theorem 3: Given a robot game in dimension one with V = {0} and an initial counter value Xq, deciding 
whether the reacher has a winning strategy from xq is NP -complete. 

Proof. • NF '-membership: The decision of the winner in a one-player robot game reduces to the 
following integer linear programming problem, which is in NP according to J7] p. 320, Th. 13.4]. 

Minimize x 

subject to x+ ^ a u u = — xq 

ueU 

x >0 

a u >0, u £U 

The minimal x is if, and only if, the reacher has a winning strategy. 

• NP-hardness: We present a polynomial-time reduction from the NP-complete Subset-Sum prob- 
lem (3] p. 1097] to the decision of the winner in a one-player robot game. For a given set 
{xo, • • • ,x n -i} of positive integers and a given positive integer s, the Subset-Sum problem asks 
whether there exists a subset / of [0,n — 1] such that £, e /X,- = s - Let (X,s) be an instance of 
Subset-Sum. Let n = \X\,b = max(X), and k = [log 2 (max(?i^,s))J + 1. We build a robot game 
where we write counter values as their binary encoding, so we deal with bits in the following. 

The basic idea of the reduction is that we start from s and give to the reacher the possibility to 
subtract some x, and try to reach 0, but it is not enough. To prevent him from subtracting twice 
the same x,-, we add a control on the highest bits of the counter value. Therefore, the initial 
counter value in the robot game is s + Ef=t _I 2' + « • 2 k+n , and every reacher move subtracts at 
least 2 k+n from the counter value in order that at most n moves can be performed. More precisely, 
U = U^U h where U t = {-x t - 2 k+i - 2 k+n ,-2 k+i - 2 k+n }. 

We now explain the link between a potential solution to the instance of Subset-Sum and a strat- 
egy in the robot game. Consider a subset / of [0,n — 1]. With at most n moves from the set U, 
the only possibility to reset the bits number k through k + n — 1 in the robot game is to decrement 
all of them once, i.e., use exactly one move from each set U{. We choose in the set [/; the move 
—xi — 2 k+l — 2 k+n if i is in / and — 2 k+I — 2 k+n else. After the n moves, the counter value is if, 
and only if, £, e /X; = s. Consequently, it is equivalent to find a winning strategy in the robot game 
and to find a subset of X that sums up to s. 

□ 

4 The complexity of two-player robot games on the integer line 

In this section, we present the tools to build an exponential-time algorithm that decides the winner in 
a robot game. First, we explain the notion of an attractor, then we define the Frobenius problem and 
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we give an over-approximation of the solution to this problem, in order to find bounds above and below 
which we are sure that the same player always wins. The algorithm in the third part computes the attractor 
and uses the bounds we get to avoid infinite recursion. At the end of the section, we prove the matching 
lower complexity bound for the decision problem. 

4.1 The attractor construction 

We first define the one-step attractor of a set. Consider a graph (Q, Q^, Qy,E) for a general reachability 
game, where Q is a possibly infinite set of vertices partitioned into subsets for the reacher and Qy for 
the opponent, and E C gx Q. The one-step attractor of a subset X of Q, written Attr(X), is the set of 
states from which the reacher can force to go to X in one step, which means: 

Attr(X) = {q G Qb such that 3q' G X, (q,q) G E} 

U {q G 2v such that \/q G Q, (q,q) G E implies q G X}. 

The attractor of X, written Attr*(X), is the set of states from which the reacher has a strategy to 
eventually go to X no matter what the opponent plays, in other words he has a winning strategy in the 
reachability game with objective X on the aforementioned arena. The set Attr*(X) is the least fixpoint of 
Attr containing X. We obtain it recursively: compute Y = X U Atrr(X), if Y = X then return Y else set 
X := Y and repeat. 

Let us adapt a robot game to these notations. The reacher owns Q3 := {0} x Z and the opponent 
owns <2v := {D} x Z. The set of edges is the union of the set {((□,*), (0,y)) | x,y G Z,y — x G V}, which 
represents the opponent moves, and of the set {((O,*), (□,)')) I x >y e Z,y — x G U}, which represents 
the reacher moves. The objective for the reacher is the vertex (□,()). In our definition of robot games, 
winning positions are counter values. They are here represented as a pair (□ or O , the counter value), 
but we only care for winning positions with □ as left component when we solve the game, because a 
play starts with the opponent. 

We use here two-step attractors Attr 2 (X) = Attr(Attr(X)), rather than one-step attractors, because of 
the round-based structure of a play in the robot game. The winning set in a robot game is Attr* ({(□,())}). 
We call it trivial if its intersection with the opponent vertices is restricted to {(□,())}, which is the 
case if, and only if, the computation of Attr* ({(□,())}) stops at the second step because a fixpoint has 
already been reached. In other words, the winning set in a robot game is trivial if, and only if, the set 
Attr 2 ({(D,0)}) is either empty or {(□,())}. 

Proposition 4: The winning set in a robot game (U, V) is non-trivial if, and only if, there exists a counter 
value x / such that, for all opponent moves v G V, there is a reacher move u €U such that u + v = —x. 

Proof. Given a counter value x / 0, a configuration (□,*) is in Attr 2 ({(□,())}) if, and only if, for any 
opponent move v G V, we have (0,JC + v) G Attr({(D,0)}, and this is equivalent to the existence of a 
u G U, which depends on v and x, such that x + v + u = 0. □ 

Let us look at the game presented in the Figure 1. Here, consider a play that starts at —3: if the 
opponent chooses to play 3, then the reacher wins by playing 0, if the opponent plays —1, then the reacher 
wins by playing 4. With the terminology of this section, it means that (□, —3) G Attr 2 ({(D,0)}). 

We define an integer version of Attr , for a subset X of Z, by 



Prepf) = {x G Z | (Vv G V )(3u G U) x + u + v G X}. 
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Note that a round begins in Pre(X) if, and only if, the reacher can force this round to end in X. Let 
X be a subset of Z, and let X opp = {□} x X. Because the predecessor of a vertex with □ in the left 
component can only be a vertex with O in the left component and vice-versa, we have Attr 2 (X opp ) = 
{□} x Pre(X). 

The next result is very important for our algorithm. We will usually be in a situation where the 
algorithm computes a bound b such that we can decide immediately for which player a counter value x 
that is greater in absolute value than b is winning. The proposition presents the bounded arena we build 
from the robot game, where termination is guaranteed for the computation of the attractor. 

Proposition 5: Consider a robot game G for which there exist two integers d G N \ {0} and b G N such 
that no negative counter value is winning and every counter value greater than b is winning if, and only 
if it is a multiple of d. We can build a reachability game on a finite arena on which the reacher has a 
winning strategy if and only if he has a winning strategy in G. 

Proof LetRestr^(<7,V) = (Q,Q 3 ,Qy,E), where: 
. <2v = {-L<o,T>*,±> fc }U({D} x p,b]); 

• Qa = {0}x [min(V),fc + max(V)J; 

• e = e 3 u<2 v ; 

• £ = {((D4(Oj))€fivxfi 3 \y-xGV} 
U{((0,x),(0,y))eQ 3 xQy\y-xeU} 
U{((0,Jc),-L<o) G 23 x £v I 3u G U,x + u < 0} 
U{({0,x),± >b ) G Q 3 x 2 V I 3m G U,x + u > b Ax + u G" dZ} 
U{((0,x),T >b ) G Qb x gv I 3w G U,x + u > b Ax + u G dZ} 
U {(J_ <0 , ±< ), (T >b , (□,())), (± >b , !>,)}. 

The reachability game played on Restr^(£/ ,V) where the reacher wants to go from (□,*) to (□,()), 
for a given 1 < x < b, is actually the robot game (U, V) with the initial value x, in which we stop the play 
as soon as we know the winner. Indeed, we supposed that all negative counter values are losing, that 
is why, on Restr^([/, V), instead of vertices (Qy,x) for x G — N we have a losing sink _L<o- Similarly, 
because in (U,V) all counter values above b are winning if, and only if, they are multiples of b, on 
Restr^(J7, V), instead of vertices (Qy,x) for x > b, we have two sinks, one winning and one losing, and 
the redirection of edges depend on the counter value. □ 

We allow the notation Restr^(t/, V) for negative integers b, given that no positive counter value is 
winning and every counter value less than b is winning if, and only if, it is a multiple of d. In fact 
Restr^(£/,V) is the arena Restr^ (—17, —V). Given d and b, we can decide the winner in the reachability 
game on using the attractor construction, because this time the arena is finite. We write 

RestrAttr(G) = {x G Z | (□,*) G Attr*({(D,0)})} where Attr* ({(□,())})} is the winning set in the game 
described above on the arena G = Restr^(f/, V). The function RestrAttr is used in the main algorithm. 

4.2 The Frobenius problem 

Let W be a non-empty subset of Z. The arithmetical notions we present in this section are part of the 
algorithm: W stands for a subset of the winning counter values. We denote by gcd(W) the greatest 
common divisor of W, and we compute it as follows: gcd({J}) = d, and for W ^ 0, gcd({w} U W) is the 
usual greatest common divisor of w and gcd(W). The integers in W are mutually prime if gcd(W) = 1. 
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The Frobenius problem asks for the greatest integer that is not W -reachable, where W is a set of 
mutually prime positive integers. 

Note that the set of non-W -reachable positive integers would be infinite without the assumption of 
mutual primality. It is empty whenever the set W contains the value 1 , in which case the solution to the 
Frobenius problem is —1, by convention. Theorem 6, which follows from [11], gives a bound to the 
solution to the Frobenius problem for a given set. 

Theorem 6: Let W be a set of mutually prime positive integers. The solution to the Frobenius problem 
for W is less than or equal to max (IV) 2 . 

Here, we are interested in a variant of the Frobenius problem on arbitrary subsets W of N or — N, 
where we look for a bound beyond which every integer is W -reachable if, and only if, it is a multiple 
of gcd(VK). When W is a set of mutually prime positive integers, this is exactly the Frobenius problem. 
Otherwise, let W C N and d = gcd(W). Consider the set W' = {*f | w € W}, which contains mutually 
prime positive integers. Let F be the solution to the Frobenius problem for W'. Then the set of W- 
reachable integers greater than dF is equal to the set of multiples of d greater than dF. Consequently, 
the solution to our problem for W is dF. For W C — N, we procede analogously. 

Actually, the computation of F is hard and the bound in Theorem 6 has at most twice the size of W. 
That is why we use the following function in the algorithm. Let ffCff such that gcd(lV) = 1. We write 
F(W) = max(lV) 2 . Let W C -N such that gcd(W) = 1. We write F(W) = -max(-W) 2 = -min(W) 2 , 
under which all integers are W -reachable. We extend F(W) when gcd(W) = d ^ I: Let W' = | w G 
W}, we set F(W) := dF{W') = max(|W[) 2 /<i. In the particular case where W is a singleton, we set 
F(W) =0. 

Finally, when W is neither included in N nor in — N, we decide W -reachability according to the 
following lemma. 

Lemma 7: Let W be a finite subset of "L that has two elements of opposite signs. An integer is W- 
reachable if and only if it is a multiple in Z ofgcd(W). 

Proof. Consider two elements w > and w' < of W. The integers — w and —w' are W -reachable 
because — w = (— w' — i)w + ww' and —W = (w — l)w' + (-w')w, which are combinations with only 
nonnegative coefficients. 

By Bezout's identity, there exist integer coefficients a w such that Y*wew a wW = gcd(VK). We replace 
a w w by (— a w ) ■ (— w) for all negative coefficients a w . The resulting linear combination has only positive 
coefficients, therefore gcd(W) is W-reachable, as well as — gcd(W). We conclude that W-reachability is 
equivalent to membership in gcd(W)Z. □ 

4.3 A theorem by Sylvester 

This section aims at giving an alternative way to bound the solution to the Frobenius problem. Using 
Theorem 6 is simpler, but we can have a sharper bound. 

Theorem 8 relies on the extended Euclidean algorithm, presented in [3, p. 937]. With an iteration of 
the algorithm to more than two integers according to the way we present the gcd of a set, we can prove 
Corollary 9. 

Theorem 8: Let a,b be two integers. Bezout coefficients for a and b, that is to say integers u,v such 
that ua + vb = gcd(a,b), can be computed with a time complexity polynomial in the size of the binary 
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encoding of a and b. 

Corollary 9: Bezout coefficients for a finite subset ofL are computable with a polynomial time com- 
plexity in the size of the binary encoding of the integers in the subset. 

The article [8] mentions a theorem concerning the Frobenius problem, due to Sylvester in ||9l . 

Theorem 10: Let W = {p,q} be an instance of the Frobenius problem. Then the greatest non-W- 
reachable integer is pq — p — q. Moreover, an integer x is reachable if and only if pq — p — q—x is not, 
which means exactly half of the integers between and pq — p — q are reachable. 

Such a simple statement does not extend well when W has more than two elements. If there are 
two mutually prime integers in W, then we can take them, else we have to find two mutually prime 
W -reachable integers to get an upper bound of the maximal non-W -reachable integer. For example, 
if W = {6,10,15}, then there is no pair of mutually prime integers in W even though gcd(W) = 1. 
Nevertheless, 25 is W -reachable and we have gcd(6, 25) = 1, hence every integer above 6-25 — 6 — 25 
is W -reachable. In any case, Proposition 1 1 gives a way to apply the above theorem and there is only a 
finite number of integers for which we cannot find out immediately whether they are W -reachable or not. 

Proposition 11: Let W be a subset ofTL such that gcd(W) = 1. There is a polynomial time algorithm 
that gives a pair of mutually prime W -reachable integers. 

Proof. If two integers in W are mutually prime, then there is nothing to do. Else consider the linear 
combination, obtained with the extended Euclidean algorithm, Yll=\ a i w i = 1 for wi,...,w„ € W. We 
suppose that the terms are ordered such that for a certain 1 < k < n + 1 all a,-, i < k are positive and all 
ai,i > k are negative. First note that n > 3, else two integers in W would be mutually prime. Let us 
distinguish three cases: 

• If k = 1, in other words all c?,- are negative, then consider the W -reachable integers p := wi and 
q := YIi=i{~ a i) w i- We apply Bezout's theorem: p and q are mutually prime because a\p — q = 1. 

• Similarly, if k = n+ 1, in other words all a, are positive, then the W -reachable integers p := w\ 
and q := YA=2 a i w i are mutually prime. 

• Else, the W-reachable integers p := J^Lf ajWj and q := £" =jfc — ajWj are mutually prime and defined 
by a non-empty sum. 

□ 

4.4 The algorithm 

We have now all necessary tools to solve robot games. The main idea is to iterate the computation of Pre 
until we establish that we can describe the winning set with the finite set obtained so far. 

We prove in Proposition 12 and its corollary that, for X the set that we compute in the first step of 
our algorithm and Win the winning set in the robot game, X C Win and that, for a well-chosen set Y' 
of X-reachable counter values, if gcd(Pre(F')) = gcd(X), then also gcd(Win) = gcd(X). Basically, the 
first step relies on this property: We compute successive Pre, and once the step ends we get gcd(Win). 
Actually, to keep control over the complexity, we do not do X := X U Pre(X), but only add to X a single 
element y of the computed Pre such that gcd(X) / gcd(X U {y}). 
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Once we find gcd(Win), there are two cases. In the first case, Lemma 7 can be applied and we are 
done, because Win has two elements with opposite signs. Hence, the winning set is gcd(Win)Z. In the 
second case, the winning set is included in one of the sets N or — N; we suppose without loss of generality 
that the winning set is included in N. Theorem 6 yields a bound above which all multiples of gcd(Win) 
and only them are winning because they are X -reachable. Therefore, the only set of counter values about 
which we still do not know whether they are winning or not is empty or bounded and, by Proposition 5, 
we can compute an attractor on the restricted arena. 

Proposition 12: Let Win be the winning set in a robot game (U, V), and d £ N be a multiple of gcd(Win) 
that is not gcd(Win). Let Y = dZ n Ampl d (U, V). Then we have Pre(Y) \ <iZ ^ 0. 

Proof. First, we establish that if Pre(rfZ) is not included in dZ, then neither is Pre(<f Z n Amp\ d (U, V)). 
Let x € Pre(<fZ) \ dZ. All counter values i + v + « for v 6 V and u G U are included in the interval 
Ampl(£/, V ) +x, a fortiori when u is chosen according to x and v such that x + v + u € dZ. In this case, x 
mod d belongs to Pre(dZ n Ampl d (U ,V))\dZ, and it is outside dZ too. 

Second, we prove the proposition by contrapositive: Suppose that Pre(<iZ n Amp\ d (U,V)) is in- 
cluded in dZ. We just proved that it implies the inclusion of Pre(<f Z) in dZ. As a consequence, from any 
counter value outside dZ, there exists an opponent move such that for all reacher moves, the next round 
begins outside dZ too, in particular it is impossible for the reacher to have a winning strategy. Hence, d 
divides gcd(Win). □ 

We need to adapt this result because we do not know whether Y C Win and we look for a statement 
that allows us to find winning counter values. That is why we define the regularity interval I(y,v) PO of a 
finite subset X of Z neither empty nor equal to {0} in a robot game (U, V). The elements of this interval 
are X -reachable if, and only if, they are multiples of gcd(X). 

• If X C N, then I( Uy) (X) := (F(X) - min(V) - min(f/) + d)+ Amp\ d (U,V), the lower bound of 
this interval is F(X). 

• If X C -N, then I {uy) (X) := (F(X) — max(V) — max(t/) — d) + Amp\ d {U,V), the upper bound 
of this interval is F(X). 

. E\se,I {UiV) (X) :=Ampl d (U,V). 

Corollary 13: Let Win be the winning set in a robot game (U, V), and X C Win such that gcd(X) = d > 
gcd(Win). Let Y' = I(uyj(X) HdZ. Then we have Pre(Y') \ dZ ^(D.As a consequence, if Win <2 dZ, then 
we can compute a certain element of the difference in space polynomial in \U\ and |V|. 

We apply this idea to the game in Figure 1 and find that —2 is a winning counter value outside — 3N, 
because if the opponent plays 3, then the reacher can play —1 and win, and if the opponent plays — 1, 
then the reacher can play 0, and in the next round he can play the difference between 3 and the opponent 
move to win. With the notations of the last proposition and of its corollary, we have F{{— 3}) =0, the 
interval / ({ _ 1A 4},{-1,3}) ({-3}) is (0 - 3 -4 - 3) + [-5, 10] = [-15,0], and Pre({-15, -12, ... ,0}) is 
not included in 3Z. We pick —2 in it. Since gcd({— 2, —3}) = 1, we know that gcd(Win) is 1. 

Theorem 14: Algorithm 1 computes the winning set in a robot game in exponential time. 

Proof of termination. The only loop in the algorithm is in the first step. Each iteration either lowers the 
variable d', more precisely replaces it by one of its divisors, or assigns the variable d to the value of d', 
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Algorithm 1: Algorithm for solving robot games on the integer line. 
Data: A robot game (U,V). 
Result: A description of the winning set. 

/* Require: Functions computing the sets we use, as defined in the 

Section 4. */ 

begin 

X^Pre({0})U{0} /* to avoid handling gcd({0}) in the first step */ 
ifX = {0} then return X 

/* Step 1. */ 
while d = do 

d' <- gcd(X) 
/<-/ (t ,,y)(X) 

/* / is a set of X-reachable counter values with a large absolute 

value */ 

Y ^Pre(7 nd'Z) 

/* From Y, the reacher can force the next round to end at a counter 
value known to be winning */ 

if Y\d"L /OthenX ^ XU {mm(Y\d'Z)} /* minimum in absolute value */ 
else d <— d! /* We know that d is gcd(Win) : we exit the loop */ 

/* Step 2. */ 

ifX£NAX£-Nthenreturn<iZ/* Lemma 7 */ 
else 

/<-Ampl(l7,V) 

b^F{X) 

ifXCNthen 

if-N r\Pre(lnd~N) ^0 then return dZ /* Lemma 7, second try */ 
else U nbd <— {x € dZ \ x>b}/* Half-line of winning counter values */ 
else 

if N n Pre(I n -dN) ^ then return dZ 

else Unbd «— {x£dZ \ x<b} 
G^Restr b d (U,V) 

/* Between and b, we compute the attractor on the restricted arena 
according to Proposition 5 */ 
return Unbd U RestrAttr(G) 
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which makes the loop stop because this value is positive. The lowering of d' occurs less times than the 
gcd of Pre({0}) U {0}, and if this set is {0}, then the algorithm stops before the first step begins. □ 

Proof of correctness. Let Win be the actual winning set, and let d = gcd(Win). 

• In the first step, the variable X is a subset of Win. We prove it by recurrence: 

- The step begins with X = Pre({0}) U {0}, which contains only winning counter values. 

- Let X C Win, let d' = gcd(X). In the loop, when a counter value y is included in X, it belongs 
to Pre(/fW'Z), where / is the regularity interval of X. Thus the reacher has a move to go 
from y to a subset of X -reachable counter values, which justifies that y is a winning counter 
value too. 

• On the other hand, if no element of Win\<fZ is found and included in X, then by Corollary 13, 
there exists none. It remains to look for elements of Win\(X)N, necessarily in dZ. 

• We distinguish three cases to prove the second step. 

- If two counter values in X have opposite signs, then Win = (X)^ = dZ by Lemma 7. 

- Else if X C N and -N nPre(Ampl(£/, V) ndN) ^ 0, then we also have Win = dZ. Actually 
we here prove this equivalent to the fact that two counter values in Win have opposite signs. 
(<=) Let xq G — N fl Win. Consider a play n that starts at xq and in which the reacher uses a 
winning strategy. The play % ends in and every round finishes in winning counter values, 
i.e., multiples of d. Let x G — N be the counter value in which a round in % ended and no more 
round ended in — N afterwards. Whatever the opponent did, the reacher forced the round that 
began in x to end in a nonnegative winning counter value. To sum up, x is a negative counter 
value in Pre(Ampl(£/, V) n dN). 

Note that Ampl(f/, V) necessarily contains negative counter values, else there would not be 
any positive winning counter value. 

(=>) Let x G — N nPre(Ampl(£/,V) fWN). In other words, for every opponent move, the 
reacher has a move such that a round that begins in x ends in a positive multiple of d in one 
round, and this multiple is less than max(t/) + max(V). Consider the reacher move as the 
image of the opponent move by a function (p : V — s- U. If the reacher plays the image by (p 
of the last opponent move dk times, for k G N big enough, then a great multiple of d, i.e., a 
counter value in (X)?$, is reached. This justifies that x is winning. 
If X C -N and N n Pre(Ampl(£/, V) n -dN) / 0, we have the same result. 

- Else, we know that all counter values in Win have the same sign. Suppose without loss of 
generality that XCR From a negative counter value, only negative or positive but surely 
losing counter values can be visited, therefore Win is included in dN. We use Theorem 6: 
every counter value above F(X) is winning. Between and F(X), we decide the winner 
using the result of Proposition 5 about the attractor on the restricted arena. 

□ 

Proof of complexity. We consider the input size as Lw£f/uvl°§(IH)- The algorithm first computes the 
set Pre({0}), which contains at most \U\ counter values, all of them have a lower size than the input size. 

Let us consider the loop in the first step of the algorithm. For any subset X of Z, let d' be the gcd 
of X and let / be the regularity interval of X. The size of / is 2 gcd(X) + mm{U) + max(£/) + min(V) + 
max(y), one of its bounds is F(X), and the size of a representation of this integer is at most twice the 
size of X. The size of the counter value y obtained in the loop using Pre on / n d'Z is bounded by a 
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polynom in the size of the integers in X. There is a logarithmic number of iterations in the loop, because 
each assignment of d' sets it to one of its strict divisors. 

We now look at the second step of the algorithm. It first checks whether two integers in X have 
opposite signs, and in case of fail makes another test on the Pre of an interval included in the amplitude 
of the game. This can be done in polynomial time. If the second test fails, then the bound b :=F(X) 
is computed, the arena G := Restr^(£/,V) is built and the reachability game on G is solved with the 
computation of an attractor, for a time complexity polynomial in the size of G. This size is linear in the 
value of b + max(V ) — min(V ). With a binary encoding, the algorithm uses then exponential time. □ 

Let us illustrate the second step of the algorithm with the example in Figure 1 again. We exit the first 
step with a subset X = {—2,-3} of the winning set such that gcd(X) = 1. Because 1 = — min(£/) < 
max(V) = 3, the opponent wins from any positive counter value (Proposition 2), it is indeed impossi- 
ble that Pre({— 2, — 1,0}) contains any positive counter value. Every nonpositive {— 2, — 3}-reachable 
counter value, i.e., every nonpositive counter value but —1, is winning. We only have to decide whether 
the reacher wins from —1, and it is not the case because the opponent can play 3 every time, which guar- 
antees that only positive counter values are visited after the first move. The algorithm decides it when it 
calls RestrAttr on the arena 

4.5 The lower complexity bound 

We are now showing EXPTIME-hardness of robot games. In order to do this, we give the definition 
of countdown games (H, which are games with one positive and strictly decreasing counter. We then 
introduce a variant of countdown games and show two successive reductions from countdown games to 
our variant and then from this variant to robot games. 

A countdown game between two players 1 and 2 is represented by a pair ((5, T),co) where S is a finite 
set of locations, T C S x (N \ {0}) x S is a set of weighted transitions and cq G N \ {0}. We consider that 
S has a particular location % Configurations in the game are pairs (s,c) G S x N, where c is a counter 
value. A play is a sequence of moves, done in the following way: from a configuration (s,c), initially 
(jo,co), pl a y er 1 chooses a value d < c called duration such that there exists a transition in T with s as 
first component and d as second component, then player 2 chooses (s,d,s') among these transitions. This 
move updates the configuration to (s' ,c — d). 

The winner of a play in a countdown game is determined once the play is blocked. Because only 
nonnegative integers appear in the configurations and positive integers in the transitions, the game is 
finite and ends when player 1 cannot find any duration to make a move. At this point, player 1 wins if, 
and only if, the counter value is 0. Deciding the winner in countdown games is EXPTIME-complete. 

We now define restricted countdown games: On the one hand, the winning condition for player 1 is 
now that the play ends in (_L,0) for a particular sink _L G S, i.e., there are no transitions with _L as first 
component; on the other hand, if there are two transitions (si,d,s\), (s2,d,s' 2 ) in T, then s\ = S2', in other 
words, a duration is specific to a location. 

Proposition 15: Countdown games reduce in polynomial time to restricted countdown games. 

Proof. There are two steps in the construction. Consider an arbitrary countdown game G = ((S,T),c), 
where S = {so, . . . Let d' be the least positive integer that does not appear in any transition in 

T. First, we build the countdown game G' = ((SU {_!_}), T U {(s,d',A-) \ s G S},c + d'), The winning 
condition for player 1 in G' is to reach (J-,0). 
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Notice that player 1 wins a play it in G' if, and only if, in the last move of it, the configuration is 
(s, d') for any location s, and player 1 chooses d! , in order that player 2 can only pick the transition 
(s, d',±). The partial play from (so,c + d') to (s, d'), corresponds in G to a play that starts at (so, c) and 
ends in (s,0), where player 1 wins. 

Second, we build from G' a restricted countdown game that we prove equivalent to G. Let G" = 
((SUS' U {±-},T"),2N(c + d')), where S' = {s[, . . . ,s' N _ l } and T" = {(s ,2nd,s) \ (s ,d,s) G T'} U 
{(si,i,s' i ),(s' i ,2nd — i,Sj) \ (si,d,sj) G T'}. Matching transitions are (so,2nd,s) G T" and (so,d,s) G T 1 , 
as well as [s' v 2nd — i,sj) G T" and (sj,d,Sj) G T'. Matching plays are it" G T" and it 1 G T' such that, 
when we exclude the moves from s G S to s' in 7r", the transitions of every move in it" and in it' match. 

The game G" is a restricted countdown game because the duration of a transition that starts in Si G S 
is a multiple of 2N plus i and the duration of a transition that starts in s\ G S' is a multiple of 2N minus z. 

Moreover, player 1 wins in G" if, and only if, he wins in G', thus in G. Indeed, consider matching 
plays it" of G" and it 1 of G ' . When the location is in S U {-L}, the counter value in it" is 2n times 
the counter value in it', because at the beginning of it" the configuration is (so,2n(co +d')) and at the 
beginning of it' the configuration is (sq,cq + d'). 

Hence, a play in G" reaches (_L,0) if, and only if, the matching play in G' reaches (_L,0). □ 

Theorem 16: Given a robot game on Z and an initial counter value, deciding whether the reacher has 
a winning strategy from this counter value is EXPTIME-hard. 

We prove the theorem by a reduction from restricted countdown games to unidimensional robot 
games. Let ((5, T),c) be a restricted countdown game, where we suppose without loss of generality that 
5 = [0,n — 1] ,so = and _L = n — 1. We name D = {do, df,-i} the set of values that appear in T as 
durations. Let k = [log 4 (c)J + 1 and k' = |_log 4 (fc)J + 1. 

We write the counter value in the robot game in base 4 and with h + n+k+k' + 1 digits, which we split 
in four parts. These parts encode durations, locations, value in the countdown game and controls from 
the least significant digit to the most significant one. We explain these notions after the presentation of the 
sets of moves U and V. The initial counter value is 4 h + c • 4 h+n + k ■ 4 h+n+k + 4 h + n + k + k \ it corresponds 
to no duration given, the initial state, the value cq in the countdown game, and a default value for the 
control part. 

Let us use an example to see how we represent a configuration in a restricted countdown game by the 
counter value in the robot game. Consider the countdown game pictured in Figure 2. We represent in Fig- 
ure 3 the first move of a play that starts at with value 8 (first line) and where player 1 chooses duration 
3 (second line), after which player 2 moves to the location 1 (third line). We set D = {1,2,3,4,5,6}. 

For simplicity, we decide that the reacher begins in the robot game, but the winning condition is still 
that the counter value becomes after the turn of the reacher. It remains computationally equivalent. 

We first give the moves of both players in the robot games as codes, in order to explain the way we 
encode a play in the restricted countdown game. Intuitively, because we split the counter in four parts, a 
risk appears that the encoding no longer corresponds to a configuration in the reduced countdown game, 
for example because of a carry. We prove that if a player tries to create such a bad behaviour, then the 
other one can react with a winning strategy. 

In a restricted countdown game, let us write Sd for the location uniquely determined by a duration d. 

The codes for the set of opponent moves are {DURATION d GOTO s' \ (sd,d,s') G T}, which 
correspond to the choice by player 2 of the next location according to the given duration. 

The codes for the set of reacher moves are {State s Choose d \ 3s', (s,d,s') G T}, which corre- 
spond to the choice by player 1 of an available duration; {Finish}, played when the winning configu- 
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Figure 2: Restricted countdown game. 
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Figure 3: Counter values in the robot game. 



ration is reached; {CANCEL (d,s') ERASE (j,a) \ (s d ,d,s') £ T, < j < k, < a < 3}, to modify the 
third and fourth part of the counter value and eventually reach when it seems that the opponent cheated; 
and {Cancel (d,s') Remove d' \ (sd,d,s') £ T, d ^ d'}, to point out a cheating from the opponent, 
i.e., cancel the last move and subtract the real duration that was chosen. When we do not specify the 
parameters like s and d in the codes, we write the type of the moves, for example State/Choose. 
We call good encoding a sequence that alternates reacher and opponent moves such that: 

• The first move is State sq Choose d for a certain d. 

• The last move is FINISH and the move before is DURATION d GOTO ± for a certain d. 

• There are neither C ancel/Erase nor Cancel/Remove nor other Finish moves. 

• For two consecutive moves State s Choose d and Duration d' Goto s', we have d = d'. 

• For two consecutive moves Duration d Goto s and State s' Choose d', we have s = s'. 

All sequences that are not the prefix of a good encoding and that have no good encoding as a prefix are 
bad encodings, and the first move that refutes in this case the first or one of the three last properties of 
a good encoding is called deviating move. A sequence that only refutes the second property is neither a 
good nor a bad encoding, and we deal separately with sequences that continue after a finish move. 

Note that for each play in the restricted countdown game the players have the possibility in the robot 
game to build with their moves a good encoding and the codes of this good encoding trace the play. The 
hard part is to handle bad encodings. To understand how it can be done, let us give the integers that 
correspond to each code. 

• Duration dj Goto s 1 == -4' + 4 /l+v '; 

• State s Choose d t == 4 l - 4 h+s - d t ■ 4 h+n ; 

• FINISH == —4 h + n ~ l — . ^\h+n+k _ ^h+n+k+k' . 

• Cancel (d h s') Erase (j,a) == -(Duration d t Goto s ')-a-4 h+n+ i -4 h+n+k ; 

• Cancel (di,s') Remove dj == -(Duration d t Goto s ')-4 j -4 h+n+k+k ' . 

It appears that every opponent move is positive and every reacher move is negative. Moreover, any 
opponent move plus any reacher move is negative, hence, if the counter value becomes negative, the 
opponent wins. 

The next proposition shows the need for both players to build good encodings. 
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Proposition 17: If a sequence is a bad encoding, then the adversary of the player who has played the 
deviating move has a winning strategy from this move onwards. 

Proof. Let us consider a bad encoding and every possibility for the deviating move: 

• An opponent move DURATION di GOTO s' whereas the expected duration was dj. 

In this case, the counter value has the i th digit at 3. The reacher then has the occasion to play 
Cancel (di,s r ) Remove dj, in order that the first two parts of the counter value become 0. From 
this point on, the reacher just has to cancel every further opponent move and erase step by step 
every digit of the third part of the counter until the value is encountered. 

This case is illustrated in the Figure 4. The first line corresponds to the second line in the Figure 3. 
Imagine that the opponent plays the deviating move DURATION 6 GOTO (second line). The 
reacher can react with Cancel (6,0) Remove 3 (third line), and then, whatever the opponent 
does (fourth and sixth line), the reacher cancels every move and erases the first and second digits 
of the third part (fifth and seventh line), which makes him win because the counter is 0. 

• A reacher move State s Choose di whereas the expected location was s' . 

In this case, the counter value has the h + s th digit at 3. Now, the opponent can take advantage of 
this error and play a move with GOTO s if, and only if, the h + s th digit has been lowered to 2 by 
the previous reacher move, therefore this digit will always be 3 after an opponent move and never 
again after a reacher move, because none of them permits to increase a digit of the second part 
or to decrease it by 2 or more, even with carries. In particular, the counter value cannot become 0. 

• A reacher Cancel/Remove move. 

Here, the first part of the counter value had only digits at just before because the opponent did 
not do a deviating move and now one digit is at 3, let us say it is the f h one. The opponent will 
always use moves with DURATION dt when the i th digit is 3 and other moves when it is 2 such that 
this digit can no longer be put to after the reacher plays, therefore the opponent wins. 

• A reacher C ancel/Erase move. 

Here, the fourth part of the counter value has been reduced, hence the move FINISH, which would 
lead to a negative counter value, should be avoided by the reacher. In other words, the opponent 
just has to match the duration of his move to the one that the reacher chose right before, like in a 
good encoding, to be sure that he wins. Indeed, the only possibility for the reacher to win is now 
to use a Cancel/Remove move, but he will lose whenever he does this meanwhile the first part 
of the counter value has only digits at 0. 

□ 

We now restrict to good encodings, for which the next proposition decides the winner depending on 
the winner of the corresponding play in the countdown game. We first need the following lemma. 

Lemma 18: Consider a prefix of a good encoding without any FINISH move. The following invariants 
hold: 

• The digits in the first part of the counter value are all after an opponent move and all except 
one 1 after a reacher move. 

• The digits in the second part of the counter value are all after a reacher move and all except 
one 1 after an opponent move. 
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Figure 4: Deviating move of the opponent and reaction of the reacher. 



Proof. At the beginning of the play, before the first reacher move, there is one 1 and other digits are in 
the second part, and all the digits in the first part are 0. This can also be seen in the Figure 3. Consider 
a good encoding. The following alternation happens: reacher State/Choose moves erase the 1 in 
the second part and increment a digit, hence a 0, in the first part; and opponent moves erase the 1 that 
appeared in the first part and increment a 0, in the second part. □ 



Proposition 19: Consider a good encoding 7t' built from a play % in the restricted countdown game. If 
player 1 wins 7t, then the reacher wins any play that begins with the prefix %' in the robot game when he 
plays the FINISH move, else the opponent has a winning strategy after the FINISH move. 

Proof. We look at the evolution of the counter value along a good encoding. Every DURATION d cancels 
the previous Choose d, every State s cancels the previous Goto s, State so cancels the 1 in the initial 
counter value, and Finish cancels the digit that correspond to ± and the fourth part. In other words, all 
parts except possibly the third one are zero at the end of a good encoding. Here, we do not consider 
possible carries from the third to the fourth part, which make the reacher lose. As for the third part, it 
first represents the initial value in the countdown game and the reacher subtracts from it the values of the 
durations chosen by player 1 in the simulated play. The counter value is also at the end of the good 
encoding in the robot game if, and only if, the corresponding play in the countdown game ends in the 
configuration (_L,0). 

Let us show why we need the Finish move. According to Lemma 18, the reacher cannot win if 
he plays State/Choose moves forever, even if he tries to make a carry appear from the third to the 
fourth part of the counter value, because there will always be a digit at 1 in the first part of the counter. 
However, with a FINISH move, no digit is incremented in the first part of the counter. Hence, the reacher 
should use this move at least once at the end of a good encoding. 

Note that, in particular, the reacher loses if he subtracts to the third part more than the initial value in 
the countdown game. 

Now, we present the winning strategy for the opponent if the reacher did not win at the moment where 
he played FINISH. The fourth part of the counter is now nullified, hence the reacher can afterwards only 
use State/Choose moves because other moves would make the counter value negative. Consequently, 
the opponent can do a move with GOTO _L and guarantee at the next step that the digit that corresponds 
to _L is never again. □ 

We conclude from Propositions 17 and 19 that the reacher has a winning strategy in the robot game 
if, and only if, player 1 has a winning strategy in the countdown game. Indeed, both players need to 
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generate a good encoding, else they know that they will lose, thus, it is just a matter of checking whether 
the reacher can enforce the good encoding to make him win. 

5 Conclusion and perspectives 

In this paper, we give an EXPTIME algorithm for solving robot games on the integer line, and prove 
EXPTIME-hardness by a reduction from countdown games. According to H, it is open whether deciding 
the winner of robot games is decidable in dimension two. It will be interesting to see if the game on a 
grid has enough regularity properties so as to adapt our algorithm for the dimension two problem. 
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